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(57)Abstract: 

PROBLEM TO BE SOLVED: To make obtainable the 
advantages of an example sentence retrieval type and an 
arbitrary sentence input type translation device by 
recognizing an input voice, converting words and phrases 
included in an example sentence template similar to the 
voice according to the voice, and displaying a translated 
sentence. 

SOLUTION: With a power button 103 pressed, a program 
in a memory is started and an initial picture appears on a 
display screen 101. When a voice is inputted in this state 
through a microphone 106, a key word voice recognition 
is performed. When a word is voiced and inputted at this 
time, a word voice recognition by speech recognition 
algorithm such as Hidden Markov Model(HMM) is 
performed by referring to a word dictionary and word 
candidates are displayed on the screen. When a user 
voices and inputs a key word, an example sentence 
template is retrieved and displayed. When the user 
speaks the example sentence template by replacing its 
replaceable words with other words, what example sentence template is used and what 
replacing word is used are recognized and a translated sentence of the input sentence is 
displayed and voiced. 
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Aasn&tf^sBB-rawj&BBBt. ± 

E^KS^T^&LTSSIR-r&^at. SJIRXS:?? 

^-rs^as^-f s c t t-r ssbirsb. 
[»ufc*2] m$g;i fceBcBBBBicis^T. $s 
ic BEBwx«**HiaTa«j»aj;&«s*rrs;:t 
swat-rsBBBB. 

at. *^A*anfcx*sB«-r**^Bin«fc, ± 

EXBfcBffiTSBX? hSiEBROBXx 
BS«*^BteB<3«±E3:*K:B-^TB»LTBI!? 

t*?at. BKXswmHfc-ra^atsar-rsct 

£#^t-fSS31R=gB. 

W*a4] CPUt, Aa***BBW**J'rB«* 
St, x^^Ht. *»©«:S:5 ! ->:/l'--h*E« 

-rsEB^ats^ru ±ie^^7>y^^«. ±e*fj» 

WIWtJ:9TBtShfcJ|lOtKiiltt^lt6ft 

ebsct- >t p h s ntttB-ca eicA^sn 

t bb^w- 6nfc«*5r >y i— h a> e> _tE» 2 
kb&i l- t«r>^i/- h £s§f& u en ufcwx? 
>^u- h $><Dm*)&±.mm 2 oi^ci^^ti^ l 
TfsiRb, iiaf^^KB, ±E»B»*£Bjs-r 
s c t £#® t -r shirhs. 
im^ms) cput, xtt^p^mmt^pmm.^ 

St, r^X^Ht, *»0«SX7 : >yu-hftE* 

U-f Si. ±E**BB^SW«B»bfcB 1 ©*J»C*t? 
^T^$nfc«»J3t^>yi/- KS^U ±ECPU 

a. ±E«x?>:7u-h#BjK3n&#B-c±E** 

BB^atf*BBb&»2©«*r£, ±E««Sn&W3t 
x>yu-htSJtKbT, ±Ej8 2 0*J«rKiE(Blbfc 
±E«Xf > h SBB U BMt L- fc^J*^ >7° 1/ 
- h S±EI 2 Of J>fc«^T«ftl/fc*jWRl/, ± 

E*^m**att. ffiiRX^^^m^-rscts^tct 

T SfiiiRSB,, 

1***6] cput, #**Birr**jsB*¥a 

t. r-f^^Ht. ?«S:<D«3J5:5 : ->yix— h«E«f 
«, ±fi**BB¥»*«BBb;fc» 1 0*)*&BgtW 

*a&u iiEcputi, Jc^mmmm-x^y^v-v 

tp©B<3 *±E**BB^»fc «fc o TBB3 ftfcS 2 © 

±EBBts*£Bjj*-rs c: t trzmmmw. 



[«*«7] »*5S4, B&S5. X«Sf**6f-E® 
©BWBBfcfc^T. ±Sr-fX^KH ±E«5R* 

IB#JH8] B*K6KE«©»B£«fciiHT. ±E 

#fi*snfc#*>T$5£t£#sit-r-5B§<!&B. 

t, ^2©f^$±ISIf^fai; c toTatl 1 X 
x-vT't, ±E**Stifc«3t?>yu— h + 
±E^2CD^(C BtJ^TBB b TBiR-T S X ^ v 
t, yV-f £SiST«Xfy^i*«E» 

Snfcn>Ka-^tt*i:0BlB«cE»«t*. 
[B#H1 0] $ 1 Cff»4f ^BiffttioTBI 

ts^f^yt. ±Efgi©^twso*ttsnfc#i:s: 

»2 0*^ttft3R$nfc«IX7 L >7 p U'-h*it«UT± 

Em 2 ©^f k ifi<H l tcmmm wx^-fv-v* mm 

*±EJB2 0«^K:*^T«*L<T«IR-r-5XT i y7 p 

t, BiRtssss^wtiais-ra^xy^tj^EBsn 
[bbobm&kb] 

[0 0 0 1] 

taswoB-raa*^] *mmrbb, & 

fc»©EB«#K:B-r4. 

[0 0 0 2] 

&3fsLTBiR-f5gBT&S. 
[0 0 0 3] mi OttaCA*X*«Rt*»R*li 

tt, **iXtt«fl!lfcB^V»TBB*ff 5 ^ 
«B*»jE<BB*ftTH*. LfrU Xft«aiTf5*< 
»*&^:**«S(«BSiB)#Bfcfc3m;fc«^fc«B 

[0 0.0 4] «^*»*iL,fc«f?^B©«-& 
fit. * r iff J»BB**iE K 3 tlU^ t IE L Vi^iR^* 
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a>m ^wz^t^ofsimifih*. c © mm £8?»-r tc 

tb. #J*fcE#!ffl¥08-328585T-«, Xtl^tlfc^tm 
M 7 - 9 * - 7, if © T ^ T © ffl « t <D f i§ 65 g; <h m & «■ 

[0 0 0 5] IB2©*e.*>CJ6ffl**nfc*nR«XStt 
SITS^}£©aiRS@tUT, flIAKE. #K?BB56-88564 

[0 0 0 6] 

»Kft£©H:8«WSfe£9£^;trt§©, jsv^eo^o 
fifW&S®T**fc«>C, fSWWfgiSSEUCfcfbT. A 

set-To j tv^fca*x**^a:»Tfr<KSH»c»3&» 

^iM^JSH. eaa§TfeSB*ig©3lU-5ffi^i:It 

(CSttfc^«... A-t. i^T...f«?7^ 'J#> 
©12 lfTt. j r^**ttJTC&v^-e-rttt*. .. 

cntt. j ^i'tu^tOtOTICS^fe 

©^4&^mr#s-a-^ £n#^iif%5i&fE-e-r. j © 

«fc 5 4^&m**nS:H t o £ < f?T C fc*«T* 

fcHsrjianTfeSflrcar&v*©-?, «D**>e.-f-#fc 
[0007] ^2©»e*^i:se>fflSsnfcMiR«»j 

©, i»#aioWR«iUT3)ifiu-«'rv». b*>u it® 
m \z$tm s n&«x 4 * = a. j: x&m-r -sse 

b < * £ fifiJX * X 9 u -)V&7jk S it £ ifrgflt * -5 

^.^«*x^o-;^©^gT«-rse3i5©*ffiT«*i§ 



IPa&tfyTte. TB*M^7 5 3fi!©¥-^tl§mBFf«t* 
oTt^. J t^omX*fLoVfc. , &. X9n-)Vhtz 
0^>*}fLfci3LTS«S r^* >J#>M£l 2 1 

[0008] *f£w<DBmz, =l— ^<o^mMm\zmv 

[ 0* 0 0 9 ] 

±EWj*»c««bfc«:£T->:> r l'-h»f'©l&^ 

fSCi^TBita^fy^. ±f3^1© ; g^i:ll 

KS/Tn^f77 , t, flS2©*J»S±E«*R»3HS: 
C±oTBit6Xri»^t. ±EH*Sftt«Xf > 

h'p ®»^£±ES2©*7*fc*tftvrBijibT 

[0 0 10] 0!|*.fcr. aiR^fiTa. &6>^CJ6fflS$ 

it, -e©xD«v hizmfrn5z>m*uaftm=i— fim 

er^^-Hcte^-^-FC^J^Ui. JRfr*, 
ft4LB£tt-?&: < . - K t>E»Tt4 fc©it 

So 

[ooii] ^m(Dmm&m<Dmmnm\zit, 

©MiLT, *»©«*«f*i:»*a-]«se5E-r 
a. SAc. ^>7'l/-haiR$ff^3fc©©1ffi l i:L 
T, ^ffib©Xffi1fffi, KB. *5±WRif©Xfe1»«* 

at, ^©^jx^>7'u-h^®s{c^^-r?.^at 

[0 0 12] ^^^U-hffilRSfT^pfcWO^aib 
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Sn&B^©BS*J:tffi»*fcjrr*^a:i. ^J5C5" 
>!7>- h©B:Jtttf«<t:Xny hfcJfASftifcfi'tiJ©* 

[0 0 13] a— tfjS«HlttS*J»A*-r<6t» 1£BS?« 
0**fliaft*flB-r*i4:KJ:-3TA*SnfcHlB*± 

«l:E»3nT^S«:£5 t >:/U-I<£tftJRU Ml; 

©-re««*«ES6snT^*. lot, mxT-yrfv—v 
&wmizi%^-?2>i&\z\t. 7.a-y Mr«atw*«jf A*n 

[0 0 14] WffilZl-?Si±<DMJC'T>7 r l'-\~tfi&^ 
tf©0faoB^J*#AbfcX**]»A*-r*. t«i. 

Btru iRX*«*-r?>. b*.«, a.— xfifi mmi t 

-y- K*»KEi£anT^*«:s:?->:7'i'- h*** 
r«. bb^s r[^ts](ifcT-r^j remans]© 

6. rjb^fcfflBBBSaut&^J 

A7J-T-5. "T -Si. Bttftft. r[H*](r[nl^^ 

>7i^- hBrcsssfx-r*. 

[0 0 15] 

[«i§ll©IM8©»B] **B©*JISW*Bia»&Bl 4 
£T£ffl^TSJBJ|-f 3„ *£BBtt. B*BS«HB<t 

gjST&£. **^BIRSBtt, 3-— !f*«*— «7-Hft 
«^ X+> t * i «Xf > 7 U— h £&St L- TiSt 5 . 
n— vf-titm-Xr >7 V- Y ©«*»*RlBfciMB«SiJ© 
WiCftljtTL^^t, <!:©0iJ:£7>7V-h£ 

*H-*BX«B5S • 
[0 0 1 6] *£ttB©Btt£©*1-B&R9J-r 
*. Bltt*BB©— *»WTas*FBBBB©*1-B 
4J±^BBBB*jR-rBT**. VPBBBBl 0 1 



«, g^SM 10 2, maiA-f yf 103, Utyh# 

5, BXtt»©*-7-F*»*Aa-r«fc«>©v-f * 

10 6, • Btt • BS38J»Bfc»jRT*fc*© 

Hff#^>10 7, Ha©®®KJ?£fc*© rgj&j 
>108. BB±SB«fe&K:»«rr*fc©©X*n- 
;t^7 > 1 0 9 ~ 1 1 2 £«*.TV»£>. 

[0 0 17] JfclC. **««©«BE©A-K>>X7« 
J«£KB-rs. B2«. **3«BBBB©A-I«?7X7 

W. MB, **^J**!JS*fT3fc«>©CPU2 0 1, ^ 
AAgi2 0 2. «^m*BB2 0 3. *f§^S2 0 
4. ^JX^r-f )V2 0 5, pt^B'J 2 0 6»C«fct>TBfiK$ 
ntl»5. > ; EU 2 0 6ICB, Mi> r n^7A2 6 1. 
*B«TO»5 r D^7A2 6 2, £*«BB:/nif5A 
2 6 3, T>yU-hSI?yDi/7A2 6 4. ^fctiTJ 
7"n^7A2 6 5. I®S^7"n^7A2 6 6*«B** 

[0018] )k\z. fl:&7 7"f;i'©rt££K9rr«. 

[0 0 19] gI6{C«X7 7"r;P©rt§^*-r. «:St7 

o i , 602, bbb:**^ 6 o 3 . 

■7-H6 0 4, m.-%=ryrfv-y 6 o 5, nut-?- > TV 

- h £E)£ U fc«#« B 6 0 6. RX? > 7 u- 
F 6 0 7, BXt->^U— h©B**EifibfcBXB* 
1f^6 0 8, Xa7hM6 0 9A»E^nTW. X 
n.y Mf ffi 6 0 9 7n7«6 0 9 1 #EifiS 
n, ^D»;H:oV>T, AOy hCA*B^©f^*B 
6 0 9 2, TC3?0iJ©f?6 0 9 3, ttSB©B©»#«» 
6 0 9 4, 7D 7 Hct*©«fc3fti§'6j;&tA*a>£:EizBL 
fcf«6 0 9 5, B*fcisB-*xn-y hSE^©:*:**; 

(ii, mm®) zmmhtz-x&mme o 9 6i>m 
[0020] mxiz\z r^*tiufcv»j ©J:3&s#0y:s: 
jmbb:*:****. **B*fc»bTtt. -t-ncara-r* 

»«BX©BXB^3W««3t#^ 6 0 3 CEJE*nT 
[0 0 2 1] +-"7-]«-CBX**:Bt-*t, 

*i±©*tc^$ns. p.— tf** r^bfcvjj £iit& 

S«bT<«SV». J &£©»BBX**B**n*. B 
Xf>7'l/- h 6 0 5*=fcZ>*iR3t7>7l/- h 6 0 7 C 

[0 0 2 2] IICjfSt-SIRCtt, JH^C7">7l/-h 

©^ d v h ic^^j 6092 ©#fi*a^^>ii^TBw■r 

B3tfc«B«©B6 .0 9 3 ^JlfeiX 
RX5I»««6 0 8l:ftSflCDRO38fi 
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16 0 9 4 5i^T^t5. 

[0 0 2 3] 7.uy h©:gefctiNt6 0 9 5 «DlEiBte. 

[0 0 2 4] ^-7-b*6 0 4K r<^Bf>J OJ:5tt» 

•^T^TO^Bfr&lftJRSn*. 3.— if** rs 
. r/txffj . *fc»4 r«ffj fcif, r<»Bf>j 

st. mxme r— #jsn<si>tt£cTra»j 

[0 0 2 5] WSMIOrttft^^TRMt*. 

h 7 #f§^»tcta#¥ffi^a 

fc"3^T, J£8§#^ 701, JLffl b 7 0 2 , 7 0 
3 , SHFflHI 7 0 4, XSHf 1 7 0 5, K 7 0 

6 . KK 7 0 7 . KB<D9B«fflF ffi 7 0 8. KR(0%j£M 

17 0 9. 09:fc#^7 1 0A«BjfiSftTH4. r<»Bf 

f 710(1 'toftm^—Fzir—v—Ffrzwx.o 
[0026] ^sl^tD^SiRSffiroib^tcr) 

ST70-ft-hTfe5. ®8£#^> 1 0 3 &W?t 
(3 0 1) . /.=EV 2 0 6 <D-7n#5&ifiBWr£tl, & 

kwwi o i c«jaBHBi*»a*aft* (302) . mm 

M!W«w*nTV»6«l?7-f* 1 0 6$IbTf^ 
3j»A***l«t, *-7-l***BB£fT3 (3 0 
3) . 

[0 0 2 7] &fc^-7- F^J&lgiiK^TEM^ 

(4 0 2) . ijif§S?«2 0 4?#1U 1^17^3 7* 
(HMM) ft£0#^Bi7JWJXAi:J:D. ¥ 

■»^««*tfv» (403) . mmmmzmwiz&xk-t 

5(4 0 4), 
[0 0 2 8] H8£JlttT¥Bfttt&»m64>M£K9i- 

8TMB(cS*$tlTt^^B4^«£(Tfa. T7?n 

name iffK«*L. ra*a«»**a:vi»^»a»iR& 

S&£S*?l/Tftff#*>€:}¥-r.fc (4 0 5) . -tO^ff 



7— ,KiUT»JEU (4 0 8) . 
7— h*BM«ia*»7-r* (4 0 9) . 3— tf^afcHT 

5*B*<mi§««fcf«tvi«-&ia, *»ft*teo— ffata 

mzmiEL (4 0 6) . fSfttfrlBSMMftafctT'SCld:** 
T££ (4 0 7) . *&, Tfeif^j #*>£jfr:i£ 

[0 0 2 9] ft*, #B^ffi«*H®Ja, 

[0 0 3 0] «S«aiKrJV»Tl!lWf *. A** 

L/fc 6. #BS£S2 0 4iZ*3V^T. ATJ^B© 

-OI/2 0 5<fcDSt>3ffil< (3 0 4) . SMi'S^TS 
(3 0 5) „ JMSaMK;:*SV»T$MH3— H 7 0 6 #133$ 

*ftr. rffifij <£^-7-F<i:-rs0yS:(ciax.T. < 

t>*WT*. <»flf>£»r»34MB=i--F**— 7-Fi"*- 
30«w#^(a, r<®H(f>j ^^.UiLt-rsmiiSfSi/ 
3— H©«A#-^7 1 0lCfE*!c3*lTV»-5. 

[0031] S9»r £^_r7_ KtbT^j^ 

9 0 1 H*5RSnfcflXT?*5. HXaBSTOKIi. 1 

\z&m2nfzM-xv>ftm<D3x-t)m7n-znz,, 4ft sin 

T*££ct£jS-r. Eli o tc&^T, r^^xj rv-f 
75j ri 4 bj fas#&*.nJfg&fg'6n?&*. 

[0 0 3 2] Jfcfc, myL&Q&friZ-D^Tm.WTZ, 4ft 
r<ft-5. 3— « s *tfiflXtfiE0a*4bfcVi*'&tt, 7,^7 

n— ;i^jj?^>th®o iff aJca^^nT^s*— 7— 

tC, iifln^^-K^/SATJ-r^i. MMCD^— 7- 
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F*J»BBS*frb (3 0 7) ,'WX©ttOa*.*ffV» 
(3 0 8) > JSg0ii*^X*^-r* (3 0 9) . 13 9 

oa^-tKawts^-r* (3ii)'. 

[0 0 3 3] ft*. «#»A.Rl«Bft»'fiJ©ftHffllX*a 

X4a*?bTt>«fcVi (3 1 2-3 1 4) . ^JX^MKL 
T^fr^-fcjf-rt, W«3*«3feff (3 2 2) . 
[0 0 3 4] ^cfc. Bli«X«jRlC"3V>TR9ir*. X 

&ffti, «*-ra»M«x*««3S*na (3 1 4) . 
ff+-*ifrt. si 2(c^-r«fc5ft r^jf&Lfci^j cd 

[0 0 3 5] X*^rB«K"Pt>TKM"r*. #IX 

*SBffi*^,ft*t63.— tf^X^^^-T-St (3 1 

5) . ^-pmm^mn-t^ (3 1 6) . 

t*. {sjxtf r»*sqExll'K:«fca*MBHJ («?flMRB 
ff#^, 1988) pp46-50{Cfe®$nTti-5HMM(Cd;S^-- 

■5. 

[0036] 0 5(c, x^BHnaao^n-s^-r. 

T. Bl 4 OJ: 5 hVh>*Mt5. 
HUB, r— #jfiti<sl>ttt*^T?T^J t^5WXr 
>Xl/- Mc»bTff6n**E««^-— f-?h>l?ifc 
4. S14{C*5^T. 1401il 4 0 2B ^f;t> 

-6HMM (BttVJloy^xJl-) MXt->7°^ 

fg^tim 6 0 6 tca^v»Tff jjfe-r-s (502) . 

[0 0 3 7] 7Dyh»»ffltf;Hl XPyMcAD 

•f. «7 7^)l'©Xn7 bfif$B6 0 9 <Z>$9icflMll 6 0 
9 5Sf*BT*H£(;:«fc9 (5 0 4) . J&B&g&BB 

XDy biZAQ 5*¥Btt. Xn7h©f*M6 0 9 

*B (5 0 5) , #«3-H#»:eSftTV>*»-&tt» 
«Sftfc«-a3-H*«FomB (5 0 6) , fat>fg£S 

nTtiaw«*»a*iiSMiwwB (507) . tr*.. 

J^BoaS*** 7 0 4l;l^TMt5 (5 0 8) . 

[0 0 3 8] HStcS*£ttTUS0iJ;$C^>XU- HC 
■3V»T*Htttt*-h-7h>*fPriEl/fc6 (5 0 9) , 



t^T, ±tt 1 0 Rt7 O y h««m UTEitS (5 
10). 

[0039] ft*, mx'ryfv- h*jift*J6>asisr 

#-X*«A*»&**fc-5©T?, S-^JXt^XI/- 
LT, X^#C»-r**B*B*-hvh>«tt-cft 
#-X#A9*3fc«WTK«ofc7l^-X©*IS 

«tOS^BSI«l*S:# 
±E©09TW:. gI14(C*b 

b^&'fML, ^•cD7i/-X€r#tf«sJX'r>Xl/-h(c 

t, r-f^/o^o-f j x**A-3fc«-&c r— 
[0040] **»es.Ttt*fis«sBB©«EHT?xD 

6»tC8«LTi< iltttTSS;^. 4$CH*£OT-*» 
±iti5©£ttfti:©£fi3tt. IfTMTl'STfeSCfcA^ 
i(Pto5f. *BS?«T#A--L£ftft^. U*>bft# 

©*B*»IoTV»*dr— ^3l«*.<, fllB^tftSWi* 

So littifioi-Stc. 7l^-XC»«r**rB*B*-h 
v h>^^LT^co7l/-X*-atr^JXx>Xl/-> 
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[Title of the Invention] Translation device, storage medium 
[What is Claimed is:] 
[Claim 1] 

A translation device comprising an illustrative sentence 
file for storing a plurality of illustrative sentence templates, 
a voice recognizing section for recognizing input voice, means 
for converting and translating a word included in the 
illustrative sentence template similar to said voice based on 
said voice, and means for displaying a translated sentence. 
[Claim 2] 

The translation device according to claim 1, further 
comprising a voice output section for outputting said 
translated sentence by voice. 
[Claim 3] 

A translation device comprising storing means for storing 
a plurality of illustrative sentence templates, a voice 
recognizing section for recognizing a sentence which was input 
by voice, means which selects an illustrative sentence template 
similar to said sentence from said plurality of illustrative 
sentence templates, and which converts and translates a word 
which can be replaced in the selected illustrative sentence 
template based on said sentence, and means for outputting a 
translated sentence by voice. 
[Claim 4] 

A translation device comprising a CPU, voice recognizing 
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means for recognizing input voice, a display, and storing means 
for storing a plurality of illustrative sentence templates, 
wherein said display displays an illustrative sentence template 
which was associated with first voice recognized by. said voice 
recognizing means, said voice recognizing means recognizes 
second voice which was input in a state in which said, 
illustrative sentence template was displayed, said CPU 
recognizes an illustrative sentence template which is similar 
to said second voice from the illustrative sentence template 
associated with said first voice, and converts and translates 
a word in the recognized illustrative sentence template based 
on said second voice, and said display displays the translated 
result . 
[Claim 5] 

A translation device comprising a CPU, voice recognizing 
means for recognizing input voice, a display, storing means for 
storing a plurality of illustrative sentence templates, and 
voice output means, wherein said display displays an 
illustrative sentence template searched based on first voice 
recognized by said voice recognizing means, said CPU compares 
second voice recognized by said voice recognizing means in a 
state in which said illustrative sentence template is displayed 
and said searched illustrative sentence template, and 
recognizes said illustrative sentence template which is similar 
to said second voice, converts and then translates the- 



recognized illustrative sentence template based on said second 
voice, and said voice output means outputs a translated sentence 
by voice. 
[Claim 6] 

A translation device comprising a CPU, voice recognizing 
means for recognizing input voice, a display, storing means for 
storing a plurality of illustrative sentence templates, and 
selecting means, wherein said display displays an illustrative 
sentence template associated with first voice recognized by 
said voice recognizing means, said, selecting means selects a 
translation illustrative sentence template from the displayed 
illustrative sentence templates, said CPU converts and 
translates word in said translation illustrative sentence 
template based on the second voice recognized by said voice 
recognizing means, and said display displays said translated 
result . 
[Claim 7] 

The translation device according to claim 4, 5 or 6, 
wherein when said display displays said searched illustrative 
sentence template, said display displays word which can be 
replaced with shade or highlight. 
[Claim 8] 

The translation device according to claim 6, said 
selecting means is a touch panel, or a button mounted to a main 
surface of the translation device. 



[Claim 9] 

A storage medium that can be read by a computer, wherein 
said storage medium stores therein a step for recognizing first 
voice by voice recognizing means, a step for searching an 
illustrative sentence template associated with said first voice 
and for displaying the same on a display, a step for recognizing 
the second voice by said voice recognizing means, a step for 
converting and translating word in said searched illustrative 
sentence template based on said second voice, and a step for 
displaying a translated result on the display. 
[Claim 10] 

A storage medium that can be read by a computer, wherein 
said storage medium stores therein a step for recognize first 
voice by voice recognizing means, a step for searching an 
illustrative sentence template associated with said first voice, 
a step for displaying a searched illustrative sentence file on 
a display, a step for recognizing second voice which was input 
in a state in which said illustrative sentence template was 
displayed by said voice recognizing means, a step for comparing 
said second voice and the searched illustrative sentence 
template, and for recognizing a translation illustrative 
sentence template which is similar to said second voice, a step 
for converting and translating word in said translation 
illustrative sentence template based on said second voice, and 
a step for displaying a translated result on a display section. 



[Detailed Description of the Invention] 
[0001] 

[Technical Field to which the Invention Belongs] 

The present invention relates to a voice translation 
device and a storage medium, and more particularly, to an 
utterance inducing type voice translation device and storage 
medium for realizing the utterance inducing type voice 
translation device suitable for travelling portable 
translation machine. 

[0002] 

[Prior Art] 

Conventional translation devices can roughly be divided 
into two kinds. One kind of translation device is a device for 
translating arbitrary input sentence, and the other kind of 
translation device is a device which searches a previously 
prepared side by side translation illustrative sentence by 
scene or keyword. 
[0003] 

As a translation device which translates a first 
arbitrary input sentence, i.e., text, many machine translation 
systems have been in the actual use. As a translation system, 
a rule-based translation in which sentence is translated based 
on dictionary. and grammar is widely employed. However, when 
description of rule is difficult when sentence expression 
(language phenomenon) which can not be handled well by grammar 



newly appears. Therefore, example of use-based translation 
utilizing example of use is also researched. 
[0004] 

In the case of a translation device which translates voice, 
there is a problem that if voice is not recognized correctly, 
correct translated result can not be obtained. To solve this 
problem, Japanese Unexamined Patent Publication No. 8-328585 
discloses a method in which answer is selected from a plurality 
of voice recognition result candidates by calculating language 
similarity degree between input voice and all examples of use 
in example-of -use database. 
[0005] 

As a translation device of a method for searching a 
previously prepared second side by side translation 
illustrative sentence, Japanese Patent Application Laid-open 
NO.S56-88564 for example discloses a portable type translation 
device in which if category is designated, illustrative 
sentence is displayed, and if a sentence is selected from the 
illustrative sentence, translated sentence of the selected 
illustrative sentence is output by voice. 
[0006] 

[Problem to be Solved by the Invention] 

During overseas travel, there are many chances to hold 
a short conversation of relatively regular contents such as 
requesting something or asking something. However, since the 



travel is not day-to-day life, a speaker can not find concrete 
speaking contents, expression or words with respect to the 
intention of utterance even in mother language in many cases. 
Thus, in the case of the translation device which translates 
the first arbitrary input sentence, since the user can not find 
a sentence to be input, the purpose for assisting the foreign 
conversation during travel can not sufficiently be achieved in 
some cases. For example, when the user gets off a plane, asks 
a place to receive hand baggage, or shows an exchange ticket 
of hand baggage to a pe-rson in charge, the user can not always 
promptly find a complete Japanese sentence such as "Where is 
a baggage-receiving place of American Airline 121?" or "My 
baggage does not come out. This is my exchange ticket of 
baggage.". When a user holds a conversation directly with a 
person who can speak Japanese which is user's mother language, 
since the user can hold a conversation while seeing reaction 
of this person, incomplete sentence such as "My baggage in the 
charge when riding, where, the name of plane? American Airline 
121.", "My baggage does not come out, exchange ticket of 
baggage? a ticket received when I got in the plane? Yes, this 
is the ticket." can be understood. When a sentence is to be 
translated into foreign language using a machine translation, 
however, a sentence can not be translated well unless complete 
sentence such as "Where is a baggage-receiving place of American 
Airline 121?" or "My baggage does not come out." is not input. 



Unlike mother language, when someone asks back "What is air 
plane number?' 1 or "Show me your exchange ticket of baggage.", 
the user can not understand. Therefore, it is necessary to 
inform the user of sentence including sufficient information 
beforehand. 
[0007] 

On the other hand, in the cast of the translation device 
which searches a previously prepared second side by side 
translation illustrative sentence, the above problems of the 
arbitrary sentence input can be avoided. Further, since the 
processing is simple, it is easy to realize as a portable 
translation machine. However, in the case of a conventional 
method in which illustrative sentences organized in accordance 
with scenes are selected by menu, if the number of illustrative 
sentence is large, it is necessary to repeat narrowing down the 
scene by pushing selecting button many times, or to scroll to 
display many illustrative sentences existing for one scene. 
Therefore, there is a problem that it takes time until desired 
illustrative sentence is found. Further, in the case of the 
conventional method for finding a replacing candidate for one 
illustrative sentence by means such as scroll, there is a 
problem that operability is poor if the number of replacing 
candidates is increased. For example* in the above-described 
example for asking a place to receive a baggage, it is 
troublesome to scroll or push a button to replace the number 
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of plane by "American Airline 121" after an illustrative 
sentence "Where is a place to receive a baggage of Japanese 
Airline 753?" is found. 
[0008] 

It is an object of the present invention to realize a 
translation device having a merit of illustrative sentence 
searching type translation device and arbitrary sentence input 
type translation device by inducing utterance using 
illustrative sentence template which is suitable for user's 
intention of utterance. 
[0009] 

[Means of Solving the Problems] 

To solve the above problem, a translation device 
comprises an illustrative sentence file for storing a plurality 
of illustrative sentence templates, a voice recognizing section 
for recognizing input voice, means for converting and 
translating a word included in the illustrative sentence 
template similar to the voice based on the voice, and a voice 
output section for outputting the translated sentence by voice 
or a display for displaying the translated sentence. Further, 
a storage medium that can be read by a computer stores therein 
a step for recognizing first voice by voice recognizing means, 
a step for searching an illustrative sentence template 
associated with the first voice and for displaying the same on 
a display, a step for recognizing the second voice by the voice 
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recognizing means, a step for converting and translating word 
in the searched illustrative sentence template based on the 
second voice, and a step for displaying a translated result on 
the display or outputting the translated result by voice. 
[0010] 

For example, in the translation device which searches a 
previously prepared illustrative sentence, the illustrative 
sentence stored in the illustrative sentence file is described 
as an illustrative sentence template including portion (slot, 
hereinafter) which can be replaced by word. A classification 
code (e.g., information such as place and date), of word 
appearing in the slot and a representative example are described 
in the illustrative sentence template as information concerning 
the slot. A keyword (e.g., information such as reservation, 
airplane and ticket) is given to each illustrative sentence 
template. The keyword includes not only concrete words, but 
also classification code. 
[0011] 

In a word dictionary of the translation device of- the 
present invention, pronunciation information and 
classification code of a word are described as information for 
searching the illustrative sentence template by keyword which 
was input by voice. As 'information for carrying out the 
template translation, grammar information of heading, 
translated word and grammar information of the translated word 
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are described. As means for searching the illustrative 
sentence template, word recognizing means for recognizing a 
keyword which was input by voice, means for searching the 
illustrative sentence template in which a recognized word and 
its classification code are described in keyword information, 
and means for displaying a plurality of illustrative sentence 
templates on a screen are provided. 
[0012] 

As means for carrying out the template translation, there 
are provided sentence voice recognizing means for selecting an 
illustrative sentence template having high similarity degree 
from the plurality of illustrative sentence templates, word 
voice recognizing means for recognizing a word which was 
inserted into the slot with reference to vocal information of 
the word dictionary, means for determining translated word and 
word format of a word inserted into the slot with reference to 
the word dictionary and translation rule, and means for 
combining translation information of the illustrative sentence 
template and translation of a word inserted into the slot, 
thereby producing a translation. 
[0013] 

If a user input a word by voice, the input word and its 
classification code are recognized by referring to the vocal 
information of the word dictionary. An illustrative sentence 
template described in the keyword information is searched and 



is displayed on the screen. In the illustrative sentence 
template, representative examples of words which can appear in 
the slot are described as information concerning slot included 
in the illustrative sentence. Therefore, when the 
illustrative sentence template is displayed on the screen, it 
is displayed in a state in which the representative example is 
inserted in the slot. 
[0014] 

In a state in which one or more illustrative sentence 
templates are displayed on the screen, a sentence in which a 
user's requesting word is inserted is input into the slot of 
the illustrative sentence template by voice. As doing so, the 
voice-input sentence is translated based on an illustrative 
sentence template having high similarity degree among the 
illustrative sentence templates displayed on the screen, and 
translation is displayed. For example, if the user inputs a 
word "telephone" by voice, an illustrative sentence template 
in which the word "telephone" is described in the keyword 
information is searched. On the screen, illustrative sentence 
templates such as "Where is [telephone]?", "Teach me how to make 
a [local call] . ", "I'd like to make a [collect call] to [Japan] . " 
are displayed. The underline shows the slot. The user 
searches an illustrative sentence which can be used while 
scrolling the screen. If an illustrative sentence which can 
be used such as "I'd like to make a [collect call] to [Japan] . " 
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is found, the user inputs a sentence "I'd like to make a 
international call to Canada. " by voice. Then, the translation 
machine recognizes that the illustrative sentence template of 
"I'd like to make a [collect call] to [Japan]." was used, and 
recognizes that [Japan] [collect call] were replaced by 

[Canada] [international call], and carries out the template 
translation . 

[0015] 

[Embodiment] 

An embodiment of the present invention will be explained 
using Figs.l to 14. This embodiment is a portable voice 
translation device used for a user whose mother language is 
Japanese and who travels English-speaking area. The voice 
translation device searches and displays an illustrative 
sentence template if the user inputs a keyword by voice. If 
the user replace a word which can be replaced in the illustrative 
sentence template by another word and speaks this word, the 
translation machine recognizes which illustrative sentence 
template was used and what word was replaced, and displays and 
pronounces a translation corresponding to the input sentence. 
[0016] 

Next, ah outward appearance of the translation machine 
of the present embodiment will be explained 4 . Fig.l shows the 
outward appearance of the voice translation device of the 
embodiment of the present invention and shows an initial screen. 



A voice translation device 101 includes a display screen 102, 
a power switch 103, a reset button 104, a speaker 105 for 
outputting a translation by voice, a microphone 106 for 
inputting a keyword for searching an illustrative sentence is 
by voice, an execution , button 107 for instructing search, 
translation, pronunciation of translation and the like of the 
illustrative sentence, a [return] button 108 for returning to 
a previous screen, and scroll buttons 109 to 112 for moving the 
screen back and forth, right and left. 
[0017] 

Next, a hardware structure of the translation machine of 
the embodiment will be explained. Fig. 2 shows a hardware 
structure of the voice translation device. The voice 
translation device comprises a CPU 201 which controls the device, 
recognizes voice, translates, and synthesizes voice. The 
voice translation device also comprises a voice input device 
202, a voice output device 203, a word dictionary 204, an 
illustrative sentence file 205 and a memory 206. The memory 
206 stores therein a control program 261, a word voice- 
recognizing program 262, a sentence voice-recognizing program 
263, a template translating program 264, a voice output program 
265 and a screen display program 266. 
[0018] 

Next, contents of the illustrative sentence file will be 
explained . 



[0019] 

Fig. 6. shows the contents of the illustrative sentence 
file. In the illustrative sentence file, the following 
elements are described for each of illustrative sentence 
templates: illustrative sentence number 601, basic 
illustrative sentence number 602, detailed illustrative 
sentence number 603, keyword 604, original sentence template 
605, pronunciation information 606 in which pronunciation of 
original sentence template is described, translated sentence 
template 607, translated sentence pronunciation information 
608 in which pronunciation of translated sentence template is 
described, and slot information 609. In the slot information 
609, the number of slot 6091 is described. For each of the slots, 
the following elements are described in the slot information 
60 9 : representative example 60 92 of word to be put into the slot, 
translation 6093 of representative example, pronunciation 
information 6094 of translation of the representative example, 
meaning information 6095 in which word to be put into the slot 
is described, and grammar information 6096 in which grammar 
characteristics (article, singular, plural and the like) of 
slot portion in the translated sentence are described. 
[0020] 

The illustrative sentences includes a basic illustrative 
sentence such as "want to make a reservation", and a detailed 
illustrative sentence such as "please find the fastest 



airplane. " . For the basic illustrative sentence, illustrative 
sentence number of a detailed illustrative sentence 
corresponding thereto is described in the detailed illustrative 
sentence number 603. For the detailed illustrative sentence, 
illustrative sentence number of a basic illustrative sentence 
corresponding thereto is described in a basic illustrative 
sentence number 602. 
[0021] 

If the user searches the illustrative sentence by a 
keyword, the basic illustrative sentence is displayed on an 
upper portion. If the user selects "want to make a reservation" 
and instructs to display the detailed illustrative sentence, 
a detailed illustrative sentence such as "please find the 
fastest airplane." is displayed. In the original sentence 
template 605 and the translated sentence template 607, word 
which can be replaced is slot. 
[0022] 

When the information is displayed on the screen, the user 
fills the slot of the original sentence template with a word 
of the representative example 6092 to display. If the user does 
not replace the word and instructs to display or pronounce the 
translated sentence, the translation 6093 of the representative 
example is embedded in the translated sentence and is displayed, 
and pronunciation information 6094 of the translation of the 
representative example is embedded in the translated sentence 
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pronunciation information 608 and is pronounced. 
[0023] 

As the descriptions of the meaning information 6095 of 
the slot, words such as "return ticket; one-way ticket; ticket" 
may be listed, or may be described using classification code 
such as "<place>". If the word can be replaced by any words, 
the condition is not described. 
[0024] 

An illustrative sentence in which a classification code 
such as "<place>" is described in the keyword 604' is searched 
from all words which have its classification code . For example, 
if the user inputs a word having a classification code of 
"<place>" such as "post office", "bus stop" or "bank" as a 
keyword, illustrative sentence 1356 "Where is nearest <S1> ?" 
is searched and displayed. 
[0025] 

Next, contents of the word dictionary will be explained. 
Fig. 7 shows the contents of the word dictionary. In the word 
dictionary, the following elements are described in each of word 
items: word number 701, heading 702, reading 703, pronunciation 
information 704, grammar information 705, classification code 
706, translated word 707, pronunciation information 708 of 
translated word, grammar information 709 of translated word, 
and illustrative sentence number 710. The illustrative 
sentence number 710 of record having, as heading, a 



classification code such as "<place>" is an illustrative 
sentence number of an illustrative sentence having the 
classification code as a keyword. 
[0026] 

Next, operation of the voice translation-device of the 
embodiment will be explained. Fig. 3 is a flowchart showing an 
outline of the operation of the voice translation device. If 
a power button 103 is pushed (301) , a program in the memory 206 
is activated, and an initial screen is displayed on the display 
screen 101 (302) . If voice is input through the microphone 106 
in a state in which the initial screen is displayed, the keyword 
is recognized by voice (303). 
[0027] 

Next, recognition of keyword voice will be explained with 
reference to Fig. 4. First, if a word is input by voice (402) , 
the word dictionary 204 is referred to, the word voice is 
recognized by voice recognition algorithm such as imbedded 
Markov model (HMM) (403) , and word candidates are displayed on 
the screen (404 ) . 
[0028] 

An example of a word candidate display screen will be 
explained using Fig. 8. In the word candidate display screen, 
kana (Japanese character) of a first candidate is displayed on 
a first line, and word candidates of the first to tenth 
candidates on second and subsequent lines. First, the word of 
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the first candidate is highlighted, but if the user uses back, 
forth, right and left scroll keys, the highlighted word moves 
backward, forward, leftward and rightward . With this, the user 
can selects desired word. The forth and subsequent candidates 
which are not shown in the screen in Fig. 8 can be seen if the 
screen is scrolled by the lower scroll key. The word candidate 
is displayed in such a manner that if homonym exists, the homonym 
is displayed on the first line, and if no homonym exists, side 
by side translation is displayed. "*" put on the head of the 
word candidate shows a keyword for searching the illustrative 
sentence . If user selects desired word and pushes the execution 
button • (405) , the word is determined as the searching keyword 

(408) , and the keyword recognition processing is completed 

(409) . If a word desired by the user does not exist in the word 
candidate, the first line of kana is selected and the execution 
button is pushed. With this, the input. word is corrected by 
kana level (406), and it is possible to search from the word 
dictionary again (407) . If "return" button is pushed, it is 
possible to return a state of keyword voice input reception. 
[0029] 

The word candidate display screen is used by the user to 
confirm the keyword voice recognition result, but it can be used 
as side by side translation dictionary because the translated 
word is displayed together with the word candidate. If the 
translated word is selected and the execution button is pushed, 



pronunciation is phonated. In the case of the homonym, no 
translated word is displayed on the word candidate display 
screen, but if the word is selected from the homonym and the 
execution button is pushed, a translated word and an 
illustrative sentence can be displayed on the next screen if 
necessary. 
[0030] 

Search of the illustrative sentence will be explained. 
If an input word is determined, an illustrative sentence having 
a number described in the illustrative sentence number 710 of 
the input word is taken out from the illustrative sentence file 
205 in the word dictionary 204 (304), and the illustrative 
sentence is displayed on the screen (305) . For a word whose 
classification code 706 is described in the word dictionary, 
an illustrative sentence having classification code as keyword 
is also searched. For example, with respect to an input word 
"bank", in addition to an illustrative sentence having "bank" 
as keyword, illustrative sentence having a classification -code 
<place><organization> is also searched. A number of an 
illustrative sentence having a classification code of <place> 
as keyword is described in the illustrative sentence number 710 
of a word dictionary record having "<place>" as heading. 
[00311 

Fig. 9 shows an example of the illustrative sentence 
display screen when an illustrative sentence is searched using 
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11 reservation" as a keyword. In Fig. 9, a reference number 901 
represents a searched illustrative sentence. In the 
illustrative sentence display screen, dictionary heading and 
translated word of a word are displayed on the first line, and 
top three sentences of the searched illustrative sentences are 
displayed on the second and subsequent lines. Illustrative 
sentences of fourth and subsequent lines can be seen by 
scrolling the screen by the scroll key. An illustrative 
sentence provided at its top with ,* is a basic illustrative 
sentence. In the illustrative sentence display screen, the 
representative example 607 embedded in a slot of the original 
sentence template is indicated, and the word can be replaced 
by means of underline. In Fig. 10, "Dallas", "Miami" and " 14th" 
can be replaced. 
[0032] 

Next, narrowing down processing of the illustrative 
sentences will be explained. Of the searched illustrative 
sentences, those which can not be displayed on the screen can 
be seen by using back, forth, right and left scroll keys, but 
if the number of illustrative sentence is large, the 
illustrative sentences can be narrowed down by further adding 
keyword. This makes it easier to find the illustrative sentence 
If the user desires to narrow down the illustrative sentences, 
a keyword displayed on the first line of the screen is selected 
(high lighted) by use of the scroll button (highlighted) , and 



the execution button is pushed. Then, if additional keyword 
is input by voice, the keyword voice is recognized (307) as is 
described above, the illustrative sentences are narrowed down 

(308), and the narrowed down illustrative sentences are 
displayed (309). Fig. 9 shows a result of search of the 
illustrative sentences having "reservation" as keyword, and 
Fig. 10 shows a result of narrowing down of the illustrative 
sentence using "flight". If the user sees the result of 
narrowing down and pushes the "return" button, an illustrative 
sentence before narrowing down is displayed (311). 

[0033] 

When an illustrative sentence having no word which can 
not be replaced is to be selected, the illustrative sentence 
may be selected by moving cursor using the scroll key (312 to 
314) . If an illustrative sentence is selected and execution 
key is pushed, translation is executed (322) . 
[0034] 

Next, display of detailed illustrative sentence will be 
explained. When an illustrative sentence is selected using the 
scroll key, if * put on the top of the basic illustrative sentence 
is selected instead of the illustrative sentence itself, and 
the execution key is pushed, related detailed illustrative 
sentences are displayed (314) . For example, in the 
illustrative sentence display screen in Fig. 9, if "want to make 
a reservation" on the third line is selected and execution key 



is pushed, translated result is displayed, and if * put on the 
left side of the "want to make a reservation" is selected and 
execution key is pushed, detailed illustrative sentence of 
"want to make a reservation" shown in Fig. 12 is displayed. 
[0035] 

Next, sentence voice recognition will be explained. If 
the user utters a sentence while seeing the illustrative 
sentence display screen (315), the sentence voice recognition 
is executed (316) . The sentence voice recognition is carried 
out by automaton control continuous word voice recognition 
algorithm using HMM described in "voice recognition by 
probability model" (electronic information communication 
institute, 1988) pp46 to 50. 
[0036] 

Fig. 5 is a flowchart of sentence voice recognition 
processing. First, with respect to the illustrative sentence 
template displayed on the screen, finite state automaton as 
shown in Fig. 14 is formed. Fig. 14 shows the finite state 
automaton formed with respect to the illustrative sentence 
template of "where is nearest<Sl>? " . In Fig. 14, reference 
numbers 1401 and 1402 represent HMMs (imbedded Markov models) 
formed from the pronunciation information of "nearest" and 
"where is". A model of a portion of the original sentence 
template is formed based on the pronunciation information 606 
described in the illustrative sentence file (502) . 



[0037] 

A model of a slot portion is formed based on the 
pronunciation information of a word which can be put into the 
slot. To do so, it is recognized which word among words 
registered in the word dictionary can be put into the slot by 
referring to the meaning information 6095 of the slot 
information 609 (504) . The word which can be put into the slot 
is a listed word (505) when words are listed in the meaning 
information 6095 of the slot, is a word (506) having designated 
classification code when the classification code is designated, 
and is a word (507) registered in the word dictionary when 
nothing is specified. These word models' are formed based on 
the pronunciation information 704 of word described in the word 
dictionary (508). 
[0038] 

If the finite state automaton is formed for the 
illustrative sentence template displayed on the screen (509), 
the voice is recognized by automaton control continuous word 
voice of input sentence recognition algorithm by means of HMM, 
and top ten words are stored as slot candidates words for each 
slot (510) . 
[0039] 

When the user utters while seeing the illustrative 
sentence template, pose may be inserted before or after a slot 
or immediately after a clause including the slot in some cases. 



Therefore, if finite state automaton of phrase divided at a 
location where a pose may be inserted is also formed in addition 
to the finite state automaton with respect to the entire 
sentence with respect to each illustrative sentence template, 
higher recognition precision can be obtained. For example, in 
the above example, finite state automatons such as "nearest", 
"bus stop", "where is", "bus stop is", "where" are also formed 
in addition to "where is the nearest bus stop?" , and the finite 
state automatons are brought into association with the 
illustrative sentence templates including this phrase. 
Further, poses are positively taken, and when a pose is inserted 
after "nearest", the translation machine displays that this 
coincides with a portion "nearest" of " where is nearest<Sl>? 
", and after the user confirmed this, user is induced to utter 
the subsequent portion. 
[0040] 

A slot insertion word is recognized in a range of 
registered word of the word dictionary in this embodiment, but 
all words can not be registered in. the dictionary beforehand. 
Although nouns such as proper noun or name of place are 
especially important for travelling conversation, they can not 
be covered with the word dictionary. However, if the user 
desires to use such words, the user knows such words in the 
original language in many cases, and the user can utter the word 
closely in many cases. Thereupon, if the user inputs a word 



of the slot portion by voice while pushing a specific button, 
it is considered that sound which was input by the user is 
embedded into the translated sentence as it t is for the slot 
portion, and the result is output. If the above-described 
method in which finite state automaton corresponding to a phrase 
is formed and they are brought into association with 
illustrative sentence template including this phrase is 
employed, it is possible to specify the illustrative sentence 
template from phrases before and after the user pushed the 
specific button and uttered. With this, it is possible to utter 
"How long should I wait for Back to the future?" using an 
illustrative sentence template of "How long should I wait for 
[this attraction]?". Concerning a specific slot such as <S1> 
in "My name is <S1> ", sound which was input by the user can 
be embedded to the slot portion of the translated sentence as 
it is. 
[0041] 

Although a subject to be compared with the voice input 
sentence is limited to the illustrative sentence template 
displayed on the screen in this embodiment, the subject may be 
the entire illustrative sentence template searched by a keyword. 
Further, an illustrative sentence template which was previously 
selected by the user or an illustrative sentence template used 
recently may be stored in "user illustrative sentence file", 
and this may be a subject of comparison. 



[0042] 

When a method in which finite state automaton 
corresponding to the phrase is formed and they are brought into 
association with an illustrative sentence template including 
this phrase is employed, it is considered that when the 
illustrative sentence template is displayed, a range to be input 
by voice is marked with wave-line and the like so as to inform 
the user that the user need not utter the entire sentence. If 
this method is employed, the translation machine can be used 
easier. For example, in the case of a sentence "Please find 
the fastest airplane. 11 , the sentence is shortened to "find the 
fastest airplane" or "fastest airplane", which reduce labor of 
voice input. 
[0043] 

Next, displaying and correcting operation of sentence 
recognition result will be explained. The sentence voice 
recognition result is indicated by moving a cursor to the 
recognized illustrative sentence template, and by replacing the 
word in slot by a word input from the representative example 
(317) . For example, the user inputs "I want a one-way ticket 
from Chicago to Seattle on 17th" by voice in a state in which 
the illustrative sentence display screen in Fig. 10 is displayed, 
and if the sentence voice is appropriately recognized, a screen 
in Fig. 11 is displayed. The user sees the sentence recognition 
result, and again input a sentence by pushing "return" button 



(318) or correct the sentence recognition result if necessary 

(319) . When the selection of the illustrative sentence 
template was not correct, if the user selects another sentence 
using the scroll key, the word in the slot portion is again 
recognized using the illustrative sentence template. When 
recognition of the word in the slot portion is not correct, if 
the slot is selected by the scroll key and the execution button 
is pushed, slot candidate words stored during the sentence 
recognition are displayed. If correct word exists in the slot 
candidate words, the user selects a word using the scroll key, 
and the word is selected by pushing the execution button. 
[0044] 

Next, translation will be explained. If a sentence which 
coincides with a sentence which was input by voice is confirmed, 
translation is instructed by pushing the execution button (320 
to 321) . If the basic illustrative sentence is selected by 
voice and * on the top of the sentence is selected and execution 
button is pushed, it is also possible to- see the detailed 
illustrative sentence (321). The template translation is 
carried out by embedding a translation of a word of the slot 
portion in the translated sentence of the illustrative sentence 
tenplate .(322). The grammar information 6096 of the slot in 
the translated sentence is described in the illustrative ' 
sentence template. The article, singular or plural of the 
translated word of the slot portion are determined by referring 
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to the grammar information 709 of the translated word of the 
word dictionary 204 together with the grammar information 6096 
of the slot. For example, when a word [apple] in which grammar 
information of "initial vowel" is described is embedded in a 
slot in which "indefinite article, singular", indefinite 
article [an] is added. When a word of [candy] is embedded in 
a slot in which "anarthrous, plural" is designated, plural 
[candies] is embedded (323). 
[0045] 

In a translated result display step (323), a translated 
result display screen shown in Fig. 13 is displayed. If the 
instructions (324) of the user is communicated by pushing 
"return" button, an illustrative sentence displayed before the 
translation is executed is displayed (325), and if the 
translated sentence is selected and the execution button is 
pushed, the translated sentence is uttered (326) , and if the 
original sentence is selected and execution button is pushed, 
next utterance illustrative sentence is displayed (327). An 
illustrative sentence to be displayed as the next utterance 
illustrative sentence is a detailed illustrative sentence when 
a sentence translated last time is a basic illustrative sentence, 
and is an illustrative sentence displayed before translation 
is carried out when a sentence translated last time is a detailed 
illustrative sentence. This is because a set of the detailed 
illustrative sentences searched by the same keyword are 



associated illustrative sentences, and it is considered that 
there is a possibility to use a plurality of sentences from these 
illustrative sentences. As alternate idea, it is considered 
that information concerning scene such as "hotel", "front", 
"shopping" in the keywords is added to each illustrative 
sentence template as another information different from keyword 
as "scene information", and only illustrative sentences having 
common scene information are displayed as the utterance 
illustrative sentence. When a new keyword is searched, it is 
also considered that information which coincides with an 
illustrative sentence which was used by the scene information 
immediately beforehand is displayed at upper portion with high 
priority, or it is assumed that the same scene is continued until 
the scene is reset, and the illustrative sentences are narrowed 
down by the scene information and displayed. 
[0046] 

The template translation is carried out utilizing the 
side by side translation illustrative sentence template in this 
embodiment, but a true object of the illustrative sentence 
template is to induce the user's utterance. Therefore, it is 
considered to carry out the translation processing by the 
machine translation using dictionary and grammar . In that case, 
it is not always necessary that the illustrative sentence 
template is side by side translation, and it may be illustrative 
sentence template of input language only. 



[0047] 

The embodiment as portable voice translation device was 
described above, the translation device may be a storage medium 
in which the flows shown in Figs. 3, 4 and 5 for realizing the 
above-described translation device are stored. As the storage 
medium, there is considered a storage medium that can be read 
by a computer, comprising a step for recognizing a word input 
by voice by voice recognizing means, a step for searching the 
illustrative sentence template associated with this word from 
the illustrative sentence file, a step for displaying the 
searched illustrative sentence file on the display, a step for 
recognizing a sentence which a user uttered based on the 
displayed illustrative sentence template, a step for comparing 
the recognized sentence and the searched illustrative sentence 
template, and for recognizing most similar one, a step for 
replacing a word which can be replaced among words in the similar 
illustrative sentence template based on a sentence which the 
user uttered and for translating the same, and a step for 
displaying the translated result on the display or outputting 
the translated result by voice. 
[0048] 

As another type translation device, another user 
'interface can be used. For example, in the case of a voice 
translation device provided at reception desk of hospital, 
office, hotel or the like, it is considered that a touch screen 



is used as the screen, and a user put his or her finger on the 
slot portion and utters only a word to be replaced. In the 
embodiment, it is assumed that the display screen is small or 
the translation machine can be handled by one hand, the 
illustrative sentence template is searched by inputting keyword 
by voice, but it is possible to classify the illustrative 
sentence templates according to scenes or the intention of 
utterance (question, request, explanation or the like) , and to 
narrow d6wn the sentence by displaying and selecting menu. 
[0049] 

In the embodiment, the voice translation device which 
translates from Japanese to English was explained, the voice 
translation device can be applied to another language. In the 
embodiment, recognition information is described with respect 
to the original sentence template and generation information 
is described with respect to the translated sentence template 
in the side by side translation illustrative sentence template. 
However, if the recognition information and generation 
information are described with respect to templates of both 
languages , it is possible to translate for both languages . When 
translation of both language is carried out, it is effective 
to bring answer illustrative sentence template into association 
with question illustrative sentence template by the same method 
which bring the basic illustrative sentence and detailed 
illustrative sentence into association with each other. 
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[0050] 

[Effect of the Invention] 

According to the present invention, it is possible to 
swiftly search an illustrative sentence template suitable for 
user's intention of utterance from keyword which was input by 
voice, and to induce user' s utterance. The user can utter while 
seeing the illustrative sentence template, the user can easily 
speak what he or she wants to say with complete sentence. 
Further, since the user can insert arbitrary word and speak as 
the user wants in the slot of the illustrative sentence template, 
it is not troublesome to replace the word. With this, it is 
possible to realize a translation device having a merit of 
illustrative sentence searching type translation device and 
arbitrary sentence input type translation device. 
[Brief Description of the Drawings] 

[Fig.l] Fig.l shows an outward appearance of the voice 

translation device of the embodiment of the present invention 
and shows an initial screen; 

[Fig. 2] Fig. 2 is a block diagram showing a structure of the 

embodiment of a voice translation device of the present 
invention; 

[Fig. 3] Fig. 3 is a flowchart showing operation of the 

embodiment of the voice translation device of the present 
invention; 

[Fig. 4] Fig. 4 is a flowchart showing procedure of word 



voice recognition; 

[Fig. 5] Fig. 5 is a flowchart showing procedure of input 

sentence voice recognition; 

[Fig. 6] Fig. 6 shows contents of the illustrative sentence 

file; 

[Fig. 7] Fig. 7 shows contents of a word dictionary; 

[Fig. 8] Fig. 8 shows an example of screen display in a word 

candidate display step; 

[Fig. 9] Fig. 9 shows an example of screen display in an 

illustrative sentence display step; 

[Fig. 10] Fig. 10 shows an example of screen display in a 
narrowing down illustrative sentence display step; 
[Fig. 11] Fig. 11 shows an example of screen display in a 
sentence recognition result display step; 

[Fig. 12] Fig. 12 shows an example of screen display in a 

detailed illustrative sentence display step; 
[Fig. 13] Fig. 13 shows an example of screen display in a 
translated result display step; and : 

[Fig. 14] Fig. 14 shows an example of finite state automaton 
with respect to the illustrative sentence template. 
[Description of Reference Numerals] 
2 01 : CPU 

202 : voice input device 

203 : voice output device 

204 : word dictionary 



205 : illustrative sentence file 
2 06 : memory 

261 : control program 

262 : word voice-recognizing program 

263 : sentence voice-recognizing program 

264 : template translating program 

265 : voice output program 

266 : screen display program 
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Fig.l 

1 Input word 

2 Execute 

3 Return 
Fig. 2 

1 Illustrative sentence file 

2 Word dictionary 

3 Voice input device 

4 Voice output device 

5 Control program 

Word voice-recognizing program 
Sentence voice-recognizing program 
template translating program 
voice output program 
screen display program 

Fig. 3 



1 Input power 

. 2 Display initial screen 

3 Recognize keyword voice 

4 Search illustrative sentence 

5 Display illustrative sentence 

6 Narrow down illustrative sentence 

7 Recognize keyword voice 

8 Narrow down illustrative sentence 
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9 Display narrowed down illustrative sentence 

10 Return 

11 User's instructions 

12 Display illustrative sentence before narrowing down 

13 Select illustrative sentence by scroll key 

14 Input sentence voice 

15 Recognize sentence voice 

16 Display sentence recognition result (replace word by 
moving cursor to illustrative sentence template and display) 

17 Correct sentence recognition result 

18 Template translation 

19 Display translated result 

20 User's instructions 

21 Utter translation 

22 Display illustrative sentence of next utterance 

23 Proceed 

24 Display illustrative sentence displayed before 
translation is carried out 

25 Display detailed illustrative sentence 

26 Display detailed illustrative sentence 

27 Translation 
Fig. 4 

6 Start 

7 . Input keyword by voice 
.8 Recognize word voice 



9 Display word candidate 

10 Select kana expression and "execute" 

11 User's instructions 

12 Return 

13 Select word and "execute" 

14 Determine keyword 

15 End 

16 Correct at kana level 

17 Search word dictionary 
Fig . 5 ■ 

1 Start 

2 Form HMM to slot starting position or the end of sentence 
based on utterance information of illustrative sentence 
template 

3 Unprocessed slot 

4 None 

5 Exists 

6 No designation 

7 meaning information of slot 

8 word set = word registered in word dictionary 

9 word set = word listed 

10 Form HMM of each word based on utterance information of- 
word 

11 word set = word having classification code of designation 

12 List words 

4 



13 Designate classification code 

14 Unprocessed template 

15 Voice of input sentence is recognized, and top ten in each 
slot are stored as slot candidates 

16 End 
Fig. 8 

17 [kousou] 

' sweet herb, high riser, concept, vendetta, high priest, 
public funeral 

* packaging, broadcast, pock 

^method; way 

execute 

return 

Fig. 9 

19 [reservation] reservation 
reservation has been made 
want to make a reservation 
want to change a reservation 

20 execute 

21 return 

22 (basic illustrative sentence) reservation has been made 
(basic illustrative sentence) want to make a reservation 
(basic illustrative sentence) want to change a 

reservation 

(basic illustrative sentence) want to cancel a 

Y- 



reservation 

(basic illustrative sentence) want to confirm a 
reservation 

Can I take part in without reservation ? 
Can I make a reservation here ? 
Do you have a discounted ticket ? 

Please find a fastest airplane. 

I want a return ticket from Dallas to Miami on 14th. 
Please contact here as soon as a seat is obtained. 

I have made a reservation at seven o'clock with four persons. 
Can I change reservation to eight o'clock? 
Fig. 10 
1 

Do you have a discounted ticket? 
Please find a fastest airplane. 

I want a return ticket from Dallas to Miami on 14th. 
Please contact here as soon as a seat is' obtained. 

2 

reservation, flight 

Please find a fastest airplane. 

Do you have a discounted ticket ? 



from Dallas to Miami on 14th 



3 execution 

4 return 
Fig. 11 

5 

reservation, flight 

Do you have a discounted ticket ? 
Please find a fastest airplane, 
from Chicago to Seattle on 17th 
Fig. 12 
6 

(basic illustrative sentence) want to make a reservation 
Can I make a reservation here ? 
Do you have a discounted ticket ? 
Please find a fastest airplane. 

I want a return ticket from Dallas to Miami on 14th. 
Please contact here as soon as a seat is obtained. 
7 

[reservation] reservation 
reservation has been made 
Can I make a reservation here? 
Do you have a discounted ticket? 

Fig. 13 
1 



I ! d like a one-way ticket from Chicago to Seattle on 17th. 

2 execution 

3 return 
Fig. 14 

4 nearest 

5 bus stop 

6 post office 

7 bank 

8 where is 
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